Ma083i 92 


RELATION  BETWEEN  THE  COMPLEXITY  AND  THE 
PROBABILITY  OF  LARGE  NUMBERS 

by 

Peter  Gacs 


STAN-CS-79-765 
September  1979 


DEPARTMENT  OF  COMPUTER  SCIENCE 
School  of  Humanities  and  Sciences 
STANFORD  UNIVERSITY 


DT1C 


UNCLASSIFIED _ 

SECURITY  CLASSIFICATION  OF  THIS  PAGE  IWtwn  P«t«  Enttnd) 

REPORT  DOCUMENTATION  PAGE 

1.  REPORT  NUMBER  2-  GOVT  AC 

STAN-CS -79-765 _ 

4.  TITLE  (and  Subtitle)  _____ 


2.  GOVT  ACCESSION  NO. 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 
3.  RECIPIENT'S  CATALOG  NUMBER 


5.  TYPE  OF  Rf 


JO  COVERED 


Relation  Between  the  Complexity  and  the 
Probability  of  Large  Numbers  r~ - . 


technical! 


7.  AUTHOR!*) 


Peter/Gacs 


STAN-CS  *79-765 


REPORT  NUMBER 
MT  NUMBER(t)  = 


^^14*76*0-^32 


9  PERFORMING  ORGANIZATION  NAME  AND  ADDRESS  | 

Department  of  Computer  Science  / 

Stanford  University  I 

Stanford,  California  94305  USA  _ 

1 T  CONTROLLING” OFFICE  NAME  AND  ADDRESS  T  T7  1 

Office  of  Naval  Research  / 

Department  of  the  Navy 
Arlington,  Virginia  22217 

14.  MONITORING  AGENCY  NAME  &  ADDRESS  (if  diff.  from  Controlling  Office) 

ONR  Representative  -  Philip  Surra 
Durand  Aeromautics  Building,  Room  165 
Stanford  University 

16.  DISTRIBUTION  STATEMENT  (of ThitTeport) 


a.  NO.  OF  PAGES 


»79f  8 


pf  thi*  report! 


Unclassified 

1 5a  DECLASSIFICATION  /DOWNGRADING”" 
SCHEDULE 


Approved  for  public  release;  distribution 


17.  DISTRIBUTION  STATEMENT  (of  the  abstract  entered  in  Block  20,  if 


18,  SUPPLEMENTARY  NOTES 


19.  KEY  WORDS  IContmuo  on  reverie  tide  if  necettary  and  identify  by  block  number) 


-IX 


20.  ABSTRACT  (Continue  on  reverie  tide  tf  necettary  and  identify  by  block  number) 


(see  other  side) 


DD,',r„1473 

EDITION  OF  1  NOV  B6  IS  OBSOLETE 


UNCLASSIFIED _ 

SECURITY  CLASSIFICATION  OF  THIS  PAGE  (When  Data  Entered) 


QH-UO 


UNCLASSIFIED 


20  ABSTRACT  (Continued) 


«vh 


.  Abstract. 

^)  ,  the  negative  logarithm  of  the  apriori  probability  M(x)  , 
is  Levin’s  variant  of  Kolmogorov's  complexity  of  a  natural  number  x 
Let  a(n)  be  the  minimum  complexity  of  a  number  larger  than  n  , 
s(n)  the  logarithm  of  the  apriori  probability  of  obtaining  a  number 
larger  than  n  .  It  was  known  that 

s(n/~|<^a(n)  £  s(n)  +  H(Ls(n)  n  . 

~'v - .  -^-4  or  -  F 

We  show  that  the  second  estimate  is  in  seme  sense  sharp. 


Accession  For" 

MTIS  GRAM 
ODC  TAB 

Unannounced 

Justification 


L.*.:  •'■  C **"*•’. Codes 


j&ist 

*  -*■*  «.  a  'd/or 

oclal 

Pt\ 

- '  J 

DO.X.1473f"*«' 

COITION  Of  1  NOV  Sfi  IS  OBSOLETE 


UNCLASSIFIED 

SECURITY  CLASSIFICATION  OF  THIS  PAGE  Data  Ent»r*dl 


Relation  Between  the  Complexity  and  the 
Probability  of  Large  Numbers 


Peter  Gacs 

Computer  Science  Department 
Stanford  university 
Stanford,  California  9U305 


September,  1979 


Abstract. 

H(x)  ,  the  negative  logarithm  of  the  apriori  probability  M(x)  , 
is  Levin's  variant  of  Kolmogorov's  complexity  of  a  natural  number  x  . 
Let  a(n)  be  the  minimum  complexity  of  a  number  larger  than  n  , 
s(n)  the  logarithm  of  the  apriori  probability  of  obtaining  a  number 
larger  than  n  .  It  was  known  that 

s(n)  <  a(n)  <  s(n)  +  H(|_s(n)j)  . 

We  show  that  the  second  estimate  is  in  seme  sense  sharp. 


This  research  was  supported  in  part  by  National  Science  Foundation  grant 
MCS-77-23738  and  by  Office  of  Naval  Research  contract  N0001U-76-C-0330. 
Reproduction  in  whole  or  in  part  is  permitted  for  any  purpose  of  the 
United  States  government. 


Relation  Between  the  Complexity  and  the 
Probability  of  Large  Numbers 

Peter  Gees 

Let  T(p)  be  a  partial  recursive  function  defined  over  binary 
sequences  with  values  among  the  natural  nvmbers  which  is  prefixless ; 

(a)  if  p1  is  a  beginning  segment  of  pg  and  T(p1)  is  defined 
then  T(p2)  =  T(p2) 

and  optimal: 

(b)  for  any  other  prefixless  p.r.  function  T'  ,  there  is  a  sequence 
p  such  that  T(pq)  ■  T'  (q)  for  all  q  . 

Let  l(p)  denote  the  length  of  the  sequence  p  .  Levin  introduced 
the  complexity 

H(x)  =  min(!(p):  T(p)  »  x} 

as  a  useful  variant  of  Kolmogorov's  complexity.  See  e.g.  [1],  also 
Chaitin  [2],  Gacs  [3]. 

We  denote  by  T(p;t)  a  computable  "approximation"  of  T(p)  : 
on  some  Turing  machine  computing  T(p)  ,  T(p;t)  is  T(p)  if  T(p) 
is  computed  within  time  t  ,  undefined  otherwise.  We  write 
H(x;t)  »  min{l(p);  T(pjt)  .  x} 

M(x)  «  2_H^x^  ,  M(x;t)  >  2"H^X}t^  , 

s(n)  =  -log  (  S  M(i) 

\  i«n 

a(n)  8  mini>n  H(i)  . 
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a(n)  and  s(n)  ,  two  extremely  slowly  (slower  than  any  unbounded, 
recursive  function)  growing  functions,  are  closely  related.  It  is  known 
that 

(1)  s(n)  <  a (n)  <  s(n)  +  H(|.s(n)j  , 

where  <  and  X  denote  inequality  and  equality  to  within  an  additive, 

<  and  «  to  within  a  multiplicative  constant. 

The  first  inequality  is  trivial,  the  second  one  is  well-known  (see 
e.g.  [U]).  A  hint  to  the  proof:  to  find  a  number  >  n  ,  we  have  only 
to  know  2  to  within  an  error  term  2~s ^  . 

We  will  show  that  the  second  estimate  in  (1)  is  sharp. 

Theorem.  Let  g(n)  be  any  positive,  monotone  recursive  function  such  that 

(2)  r  2'8(n)  =  -  . 

n 

Then  a(n)  >  s(n)  +  g(s(n))  infinitely  often. 

Proof.  It  is  well-known  (see  e.g.  [5])  that,  if  ^(njt)  is  a  computable 

nonnegative  rational  function  over  pairs  of  natural  numbers,  monotone  in  t 

and  E  u(n;t)  <  1  ,  i.e.,  for  each  t  ,  u(n;t)  is  a  semimeasure,  then 
n 

p,(n;t)  <  M(n)  . 

Put 

s(n;t)  s  E  M(i;t) 
i  >n 

Sn(n;t)  =  E  (i(ijt) 

i  >n 
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m(k;t) 


=  max  {el:  s(n;t)  <  k} 
m^(b;t)  =  max{n;s^(n;t)  <  k)  . 

The  construction  depends  on  ,  a  fast-growing  recursive  sequence. 

We  will  see  at  the  end  of  the  proof,  how  we  should  choose  it  in  dependence 
of  g  . 

Let  ^(njO)  =  0  . 

Suppose  that  p,(n;t)  is  already  constructed.  Put 

k(t)  =  max{k  >  -log(l  -  s^(0;t) ) :  ai  e  [n^+l,  n^] 

(3)  a(m  (i-g(i)jt)jt)  >  i)  . 

Put  n(t)  =  •  Let  j(t)  =  max{j:  ^(j;t)  >  0}  .  Put 

n(j(t)+l;t)  =  2_n(t) 

n(j;t+i)  =  jx(J;t)  for  t  i  J(t)  . 

We  will  show  that  there  are  infinitely  many  i  ’s  such  that  for  almost 
all  t  ,  (3)  holds. 

This  implies,  of  course,  that 
a(m  (i-g(i))  >  i  . 

That  is,  for  seme  n  ,  with 
i-g(i)  >  s  (n) 

a(n)  >  i  >  s^(n)  +  g(i)  >  s(n)  +  g(i)  >  s(n)  +  g(s(n)) 
and  the  theorem  will  be  proved. 

Suppose  that,  on  the  contrary,  there  is  a  largest  iQ  among  the  i 
such  that  (3)  holds  for  almost  all  t  and  a  least  tQ  such  that  (3)  holds 
for  i^  and  all  t  >  t^  . 
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Uhder  the  above  assumptions. 


s  (0;t)  1  • 

Therefore 

Z  2-n(t)  =  1  . 

*  *2 

Notation.  A(t,,t,J  =  £  2~n^  ; 

t=ti 

B(tl,t2,ko)  “  2  {2_n^:  t  €  [t-jjtg]  ,  k(t)  =  1^}  . 


Lemma.  There  exists  a  triple  (k^t^tg)  with  kQ  >  k(tQ)  , 
tg  >  t^  >  tQ  such  that 

(a)  k(t)  >  kQ  for  t  e  [t-^tg]  ; 

-nk  -1 

(b)  2  0  <  A(tjjtg)  <  3  BCt^t^ko)  . 

Proof.  For  some  t^  ,  (k(t^),tQ, t^)  will  satisfy  (a)  and  the  first 

inequality  of  (b). 

Let  us  say  that  (k^t^tg)  <  (k^,t^,tp  if  k£  <  ,  t^  <  tx  < 

Let  (kgjt^tg)  be  a  minimal  triple  <  (k(t0)>tQ,t0)  ,  among  the 
triples  satisfying  (a)  and  the  first  part  of  (b). 

(A)  For  tj  c  [t^>tg]  we  have  k(t)  =  1^  ,  otherwise  the  triple  is  not 
minimal. 


For  similar  reasons  we  have 


(B)  If  <  t£  <  t'2  <  tg  and  k(t)  >  in  [t£,t£]  then 
then  B(tj,t£)  <  2  . 
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Therefore  we  have 


A(t1#t2)  <  BCt^tg.ty  +  a+tftcItytg]:  k(t)  »  1^3.2 

-v 

<  2B(t^,tg,  k^)  +  2  .  □ 

We  concentrate  now  on  a  triple  (k,t^,tg)  <  (k(t0),tQ,t0) 
satisfying  (a)  and  (b). 

Notation.  For  i  e  [n^^n^]  put 

=  {te  [t^tgj:  an  H(n;t)  <  i  ,  H(n;t)  <  H(n;t-1)}  . 

We  now  estimate  ^  from  below  (see  (5)).  Let  us  write 

Ei  -  f*u' V  —'*1.^  '  "here  *11  <  ‘ij.1  •  *“*  *10  -  V1  ’ 

t^s  =  tg  .  Let  =  the  last  t  in  [t^+l,t^+^J  (if  any)  with 

k(t)  m  k  .  If  there  is  no  one,  u^  =  t^  . 


Let 


algorithm  we  have 


151  2-"<*>  , 


=  -log  cr^  .  Then  by  our 


«(®  (i  -e(i)) ;  ui;J-i)  <  i  . 

Cn  the  other  hand,  by  the  definition  of  u^  , 
Gt(j(tid+i)  ;uid-i)  >  i  . 


Therefore  we  have 


s(j(t.  .+1)  ;u.,-l)  >  i-g(i) 


On  the  other  hand. 


;Vi 


<  £  2 
t  = 


-n(t) 


E  2“°^  +  E  +  B(t1,t2,k) 


<  si*2  ^  +  (si+l)2“i  +  g(i)  +  Btt^t^k)  . 


Using  (h)  of  the  Lemma, 


<  (Si+1)(2  n]t  +  2"i  +  g(i))  <  2(Si+l)(2"i+g(i)) 


Hence 


si  i  3 


1  '“k-l*  1  " . 

7*2  ~  -L  , 


that  is,  for  i  -  g(i)  >n^_^  +  2  : 

i  _nv  i  +  i  -sfr) 

(5)  s.  >  {.2 

Put  =  min{i:  i-g(i)  >nJt_1  +  2} 
We  have 


,-i  _  v  t  „-mk 


1  >  s(0;t2)  -  8(0;^)  >  E  *2_  -(s^s^)  +  2  -s 

i  =  k 

\  .  V1  «. , 

=  £  •  2’1  *i  -  E  2_1  1  •  Si 

i  =  mk  i  =  mk 

y  ?-i-i  i  *vi  ^  2-g(i) 

■  l-«k  1 

If  n^  is  chosen  far  enough  from  ,  this  will  obviously  lead 

to  a  contradiction.  □ 


r: 
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